Skip to main content

Reply to this post | Go Back
View Post [edit]

Poster: ArchiveFan100 Date: Jun 20, 2010 1:14am
Forum: web Subject: Date for Next Update

Hey guys,

I realize that there is a new update coming within the following months, adding new sites and such to the Wayback Machine.

Is there a date scheduled for it? Or will there be a date announced?

Also, there's something I'm not clear on regarding site updates with the Wayback Machine. Are individual sites updated on a periodic basis? Or are all the crawled sites added to the Wayback Machine at once?

Is it possible that there could be a lag with updates? Say a site existed from 2004 and effectively 404'd in 2007. Is it possible that a 2010 update could contain earlier pages from 2004 and 2005?

Thanks in advance for the reply. Take care guys.



This post was modified by ArchiveFan100 on 2010-06-20 08:12:33

This post was modified by ArchiveFan100 on 2010-06-20 08:14:16

Reply to this post
Reply [edit]

Poster: gojomo Date: Jun 21, 2010 3:43pm
Forum: web Subject: Re: Date for Next Update

We have not announced and do not plan to announce specific dates for index or software updates -- except "coming soon, this year".

Sometimes updates may be incremental, and other times a big-catch-up update may occur. In general, updates don't happen 'site-by-site' but rather 'era-by-era' (where eras may be as small as a few months).

Material may not always appear strictly in the order it was crawled; sometimes older info gets added later, if for some reason it was missed or kept-out of the earlier indexing operations. However, it would be very, very unlikely that anything from 2004-2005 missed all previous indexing sweeps and would be included in a future sweep.

- Gordon @ IA

Reply to this post
Reply [edit]

Poster: purplemath Date: Jul 4, 2010 4:37pm
Forum: web Subject: Re: Date for Next Update

There have been no updates for more than two years now, and older material is quietly being deleted. There seems no evidence that this service is still functional in any meaningful manner.

At a guess, the Internet Archive is being shut down, or its database is being streamlined for possible sale or take-over. Unfortunately, though, nobody here seems authorized to tell us what is really going on.

Eliz.

Reply to this post
Reply [edit]

Poster: jonc Date: Jul 4, 2010 5:46pm
Forum: web Subject: Re: Date for Next Update

With the content and the volume of the Internet now, it seems inevitable that they would scale back from their original plan on the Wayback Machine. Other things (texts, audio, video) are given higher priority now with limited resources. I almost hate to say it, but maybe Google should assume control of the WM.

Reply to this post
Reply [edit]

Poster: gojomo Date: Jul 6, 2010 2:56pm
Forum: web Subject: Re: Date for Next Update

Actually, there was a *tiny* index update last week, and larger updates of software and indexed content from the last 2 years are coming this (northern-hemisphere) summer.

Older material only disappears because of either...

(1) legitimate removal requests in accordance with our published policies, which you can read about at this FAQ:

http://www.archive.org/about/faqs.php#2

(2) occasional storage/system/software failures

While some historically-important sources of archived web data (Alexa Internet) are now providing somewhat less material, we're pursuing other web-collection projects to make up the difference.

So we're not going anywhere. Stay tuned.

- Gordon @ IA